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In re Application of SUBRAMANIAN et al. 
Serial No. 10/683.630 

REMARKS 

The Office action has been carefully considered. The Office action r^ected 
claims 17 and 60 under 35 U.S.C. §112, second paragraph as being indefinite due 
to the use of the tenri "hit-testing." Further, the Office acBon rejected claims 1-67 
under 35 U.S.C. § 101 as being directed to non-statutory subject matter. Further 
yet, the Office acUon rejected claims 1-16, 18-59. and 61-67 under 35 U.S.C. 
§ 102(e) as being anticipated by U.S. Patent Publication 2004/0093604 Al to 
Demsey et al. ("Demsey). Finally, the Office action objected to daim 8 for 
informality due to a typographical error. Applicants have amended claim 8 to 
correct the typographical enor. Regarding ttie daim rejections. appHcants 
respectfully disagree. 

By present amendment, daims 1 . 8. 36, and 65 have been amended for 
darificab'on and not in view of the prior art Applicants submit that the daims as 
filed were patentable over the prior art of record, and that the amendments herein 
are for purposes of darilying the claims and/or for expediting allowance of the 
daims and not for r^isons related to patentability. Reconsideration is respedfully 
requested. 

Applicants thank the Examiner for the interview held (by tetei^one) on April 
25, 2005. During ttie intenHew, the Examiner and applicants' attorney discussed 
the daims with respect to the prior art. The essence off applicante' position is 
incorporated in the remarks below. 



14 



PACE 1 BOB • RCVD AT S/t3/2009 3:29: 57 PM gastem Da ylight Tbne] • SVR:USPTO.EFXRP-1/3 • DNIS:872g30B • CSID:425 838 81)57 • OURAnON (mm.ss):a8.42- 



nan 13 05 12:34p Hichalik 



(425) 836-8357 



p. 17 



In re Application of SUBRAMANIAN et al. 
Serial No. 10/693.630 

Prior to discus^ng reseons why applicants believe that the claims in this 
application are dearly allowable In view of the teachings of the dted and applied 
references, a brief description of the present invention is presented. 

The present invention Is dbected to a new approach to computer graphics 
that utilizes a new element object model and a vector graphics markup teinguage 
for accessing element object models in a manner that allows pn^ram code 
developers to consistently interfeoe with a scene graph data structure to produce 
graphics. This new system and method Includes a media integration layer (MIL) 
which provides an application program interfece (API) for programmers to 
accomplish possibly complex composition effects within their applications in a 
straightforward manner, while leveraging the graphics processing unit in a manner 
that does not adversely impact normal £4>ptication performance. 

One aspect of the present invention is generally directed to an architecture, 
refened to as the media integration layer (MIL), that includes an immediate mode 
graphics application programming intorfece (API), a screen-partitioning data 
structure, a set of control level objects, and a markup language. In general, the 
architecture may allow program code, such as an application or operating system 
component, to communicate drawiig instructions and other information (e.g., 
image bitmaps) to graphics components in order to render graphicari output on ttie 
system display. The present Inventton may provide a number of defined functions 
and methods, e.g., in the fonn of APIs to an object model, that enable programs to 
populate a scene graph with date stmctures. instruction lists (drawing primitives / 
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commands), and other graphics-related data. When processed, the scene graph 
results in graphics being displayed on the screen. 

Via the interfaces, the MIL may provide access to a data structure for storing 
visual infbnmatlon so that applications can take advantage of the graphics 
capabilities provided by the computer hardware. The interfeces may support an 
element object model and a vector graphics markup language for using that 
element object model in a manner that allows program code developers to 
consistently interface with a scene graph data structure to produce graphics. The 
data structure may also be used for either directly rendering or for "compiling" the 
visual infomnation so that it can be provided to a lower level graphics system for 
^st composition and animation 

Note that the above description is for example and informational purposes 
only, and should not be used to interpret the claims, which are discussed below. 

ReiecHons under S112 

The Office action rejected claims 17 and 60 as being indefinite due to the 
use of the term "hit-testing." More specifically, the Office action contends that the 
term, hit-testing, is vague and ambiguous. The Office action goes on further to 
state that it is not urKlerstood as to how one determines the manner in which hit 
testing should be conducted and that the applicants' disclosure fails to provide an 
adequate descr^tion. Api^icante respectfully disagree. 

The temi hit, as well understood in the art, is a successful retrieval of 
particular date, a record, or a web site from a cache, datebase, or computer 
networic. The temn. hit, may be contextual and typically refers to the particular 
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context in which hits are sought, /.a, a relevant web site is a successful hit when 
searching for web sites, a relevant data record is a successful hit when searching a 
database of records, etc. The process of hit-testing, in turn, is also well understood 
in the art, as the process of collecting, assembling, and analyzing data associated 
with a test directed to hits (whatever the context may be). 

Thus, in the context of the present invention, it is understood and specifically 
recited in the specification (see page 188 of the applicants' specification) that hit 
testing is used to select visuals in a scene. For example, when visuals are called 
for, (via an API or othenAftse), appropriate visuals may be located in a visual tree 
structure to fulfill such calls. Some high-level scenarios include lasso selection and 
rubber band selection, keyboard navigation (used to find the next element to switch 
focus), detemdintng mouse focus in the element tree, selecting overlapping 
elemente with transparency (such as images), "thought bubble" hit testing and 
selecting a character hit in text. 

In general, hit-testing provides consistency across Core, Framework and 
Controls, and operates by starting from the top of ttie contr<ri tree, and retuming a 
control or set of controls by a point or geometry. A control can define whether it is 
hit or not with support services including rendered geometry, bounding box, out-of- 
band geometry (hit region), image opacity or mask, and its own logic. The control 
can return specifto hit-related data on hit {e.g., line, character position, and so 
forth). 

A hit test mechanism may filter hit test results in an efficient manner. 
Further, the hit test mechanism may provide flexibility for extending to other types 
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of visuals and resolving down to sub-primitives within the visual, e.g., a 
RetainedSDVIsual is one example of this. 

Applicants submit that the term, hit-testing, is not vague or ambiguous, 
whether consideied alone or in the context of the applicante' specification. Clearly* 
there is ample support, both in the general knowledge in the art, as well as within 
the applicant' own specification, to provide adequate understanding of the use of 
the temn and the concept Applicants submit that the rejection of claims 17 and 60 
under §1 12, second paragraph Is erroneous and request that this rejecHon be 
withdrawn. 

Rejections mhsI^SIOI 

The Office action rejected claims 1-67 as being directed to non-statutory 
subject matter. Applicants respectfully disagree but have amended dainns 1 , 36 
and 65 to more particularly pdnt out and distinctly claim the subject matter of the 
invention directed toward a computer-implemented method and a computer 
system. 

Amended claim 1 recites a computer-implemented method that comprises 
receiving a function call, interpreting graphics-related data, and causing a change 
in a scene graph. Amended claim 36 recites a computer system having a scene 
graph data structure, an object model, and an application program interface. And 
claim 65 redtes a computer system having application program interface means for 
receiving function calls, high-level composition means for integrating graphics- 
related data and/or media-related data received via the interface means into a 
scene graph, and rendering means for converting the scene graph into output that 
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may be transmitted or displayed. For at least these reasons, applicants submit that 
claims 1-67 are directed to statutory subject matter and that the §101 rejections be 
withdrawn. 

Reiections under S102 

Turning to the §102 rejection of claim 1. amended daim 1 recites a 
computer-implemented method for arranging computer graphics data for 
processing into an output, comprising receiving a function call via an application 
program interface of a media integration layer, the function call corresponding to 
graphics-related data and causing data in a scene graph data structure to be 
modified based on the function call. 

The Office action rejected claim 1 as being anticipated by Oemsey. 
Specifically, the Office action contends that Demsey teaches a metl>od for 
arranging computer graphics data for processing into an output, comprising 
receiving a function call via an interface of a media integration layer, the function 
call corresponding to graphics-related data and causing data in a scene graph data 
structure to be modified t>ased on the function call. The Office action cites FIG. 1 
and paragraphs 23, 25, 28, 79, and 91 as support for these rejections. Applicants 
respectfully disagree. 

Demsey is generally directed to a method and system for accessing drawing 
resources by recognizing two portions of a computer environment, namely a 
managed code portion and a native code portion. More specifically, 
communications kietween the managed code portion and the native code portion 
involve storing, retrieving, and passing of drawing resources. When a drawing 
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resource is called for within the native code portion of the environment^ a value 
associated with the drawing resource is compared to a value already stored with 
the native code. Depending on whether the values are the same or different, the 
method either retrieves (when the same) or creates (whm different) the 
appropriate drawing resource. 

However, Demsey is an example of a system and method for dealing vMi 
conventional graphics-related data. Unlike applicants' invention, the graphics- 
related data or drawing resources in Demsey do not emt>ody a media integration 
layer (MIL) with a dedicated application program interface. 

In contrast, claim 1 recites receiving a function call via an application 
program interfeice. Demsey does not disclose receiving a function call via an 
application program interface. Further, claim 1 recites that the application program 
interface is part of a media integration layer. Demsey does not disclose utilizing 
any type of layered infomiation, let alone a media Integration layer. Applicante 
submit that daim 1 is allowable over the prior art of record for at least these 
reasons. 

Applicants respectfully submit that dependent claims 2-16 and 18-35, by 
similar analysis, are allowable. Each of these claims depends either directly or 
indirectly from claim 1 and consequmtiy includes the recitetions of independent 
claim 1 . As discussed above, Demsey fails to disclose the recitations of claim 1 
and therefore these claims are also allowable over the prior art of record. In 
addition to the recitations of claim 1 noted above, each of these dependent claims 
includes additional patentable elements. 
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For example, claim 2 recites wherein causing data in a scene graph data 
structure to be modified comprises invoking a lunction to initialize a new instance of 
a visual class. Demsey does not disclose a class as commonly used in object- 
oriented programming. For at least this additional reason, applicants submit that 
daim 2 is allowable over the prior art of record. 

As another example, daim 34 recites wherein caiming data in a scene graph 
data structure to be modified comprises Invoking a function to place an object 
conresponding to audio and/or video data into the scene graph data structure. 
Again, Demsey does not disclose utilizing objects as commonly understood witfiin 
the context off object-oriented programming. Thus, Demsey cannot possibly 
disdose Invoking a function to place an object conresponding to audio and/or video 
data into the scene graph data structure. For at least this additkmal reason, 
applicants submit that daim 34 is allowable over the prior art of record. 

Turning to the next independent claim, amended daim 36 recites in a 
computing environment, a computer system comprising a scene graph data 
structure of a layered system for containing data that can be rendered into output 
that for subsequent integrated output that can be viewed and an object model 
Induding objects and other data that can be contained in the scene graph data 
statcture, at least some of the objects of the object model having application 
program interfaces for invoking functtons to modify contents of the scene graph 
data structure. 

The Office action rejected claim 36 as being anticipated by Demsey. 
SpecificaNy, tiie Office action contends that Demsey teaches system comprising a 
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scene graph data structure of a layered system for containing data that can be 
rendered Into output that for subsequent integrated output that can be viewed and 
an object model including objects and other data that can be contained in the 
scene graph data structure, at least some of the objects of the object model having 
interfaces for invoking functions to modify contents of the scene graph data 
structure. The Office action cites FIG. 1, FIG. 3. FIG. 4, and paragraphs 23, 25. . 
28, 79, and 91 as support for these rejections. Applicants respectfully disagree. 

As discussed at>ove, Demsey is generally directed to a method and system 
for accessing drawing resources by recognizing two portions of a computer 
environment, namely a managed code portion and a native code portion. More 
speciflcaily, communications between the managed code portion and the native 
code portion involve storing, retrieving, and passing of drawing resources. When a 
drawing resource is called for at the native code portion of the environment, a value 
associated with the drawing resource is compared to a value already stored with 
the native code. Depending on whether the values are the same or different, the 
method either retrieves (when the same) or creates (when different) the 
appropriate drawing resource. 

However, as also discussed above, Demsey is an example of a system and 
method for dealing with conventional graphics-related data. For example, the 
graphics-related data or drawing resources in Demsey do not embody a media 
integration layer (MIL) with a dedicated application program interface. 

In contrast, claim 36 recites an object model having visual objects that have 
an application program interface. Demsey does not teach visual objects having an 
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application program interlace. Further, claim 36 recites a scene graph data 
structure of a layered system for containing data. Demsey does not disclose 
utilizing any type of layered information, let alone a layer for scene graph data. 
Applicants submit that claim 36 is allowable over the prior art of record for at least 
these reasons. 

Applicants respectfully submit that dependent claims 37-59, and 61-64, by 
^milar analysis, are allowable. Each of these claims depends either directly or 
indirectly from claim 35 and consequently includes the recitations of independent 
claim 35. As discussed above, Demsey fails to disclose the recitations of claim 35 
and therefore these claims are also allowable over the prior art of record. In 
addition to the recitations of claim 35 noted above, each of these dependent claims 
includes additional patentable elements. 

Turning to the last independent claim, amended claim 65 recites in a 
computing environment, a computer system comprising application program 
interface means for receiving function calls, high-level composition means for 
integrating graphics-related data and/or media-related data reoaved via the 
interfiaoe means into a scene graph, and rendering means for converting the scene 
graph Into output that may be transmitted or displayed. 

The Office action rejected daim 65 as being anticipated by Demsey. 
Spedfically, the Office action contends that Demsey teaches a system comprisir^ 
interface means for receiving function calls, higfvlevel composition means for 
integrating graphics^Iated data and/or media-related data received via the 
interface means into a scene graph, and rendering means for conv^ing the scene 
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graph into output that may be transmitted or displayed. The Office action cites 
FIG. 1 , the Abstract, and paragraphs 23. 25. 28. 79, and 91 as support for these 
rejections. Applicants respectfully disagree. 

Once again, Demsey is directed, generally, to a method and system for 
accessing drawing resources via a managed code portion and a native code 
portion of a drawing system. More specifically, communications between the 
managed code portion and the native code portion involve storing, retrieving, and 
passing of drawing resources. Demsey is an example of a system and method for 
dealing with conventional graphics-related date. For example, the graphics-related 
date or drawing resources in Demsey do not embody a media integration layer 
(MIL) with a dedicated application program interface. 

In contrast, claim 65 recites an an application program interfaoe means for 
receiving function calls. Demsey does not teach any application program intertece. 
Further, claim 65 recites a high-level composition means for integrating graphics^ 
related date and/or media-related date received via the interface means into a 
scene graph. Demsey does not disclose utilizing any type of interface means for 
integrating graphics-related date. Applicante submit that ciavn 65 is allowable over 
the prior art of record for at least these reasons. 

Applicante respectfully submit that dependent claims 66-67, by similar 
analysis, are allowable. Each of these claims depends either directly or indirectly 
from claim 65 and consequently includes the recitetions of independent claim 65. 
As disojssed above, Demsey fails 1o disclose the recitetions of dalm 65 and 
therefore ttiese claims are also allowable over the prior art of record. In addition to 

24 



PAGE26Q9'RCVDAT 9/13/2005 3:29:97 PM {Eastern Daylight Tbne] * 8VR:U8PTO-EFXRF-1/3 • DN18:8729308 * C8ID:429 830 8997* DURATION (»nm-ss):08^^ 



05 12:37p 



Michal ik 



(425) 836-8957 



In re Application of SUBRAMANIAN et al. 
Serial Mo. 10/693,630 

the recitations of claim 65 noted above, each of these dependent claims includes 
additional patentable elements. 

For at least these additional reasons, applicants submit that all the claims 
are patentable over the prior art of record. Reconsideration arxJ withdrawal of the 
rejections in the Office action is respectfully requested and early allowance of this 
application is earnestly solicited. 
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CONCLUSION 

In view of the foregoing remarks* it is respectfully submitted that claims 1-67 
are patentable over the prior art of record, and that the application is in good and 
proper form for allowance. A favorable action on the part of the Examiner is 
earnestly solicited. 

If in the opinion of the Examiner a telephone conference would expedite the 
prosecution of the subject application, the Examiner is invited to call the 
undersigned attorney at (425) 836-3030. 



Respectfully submitted, 




Attorney for Applicants 

Law Offices of Albert S. MIchalik, PLLC 

704 - 228th Avenue NE, Suite 193 

Sammamish, WA 98074 

(425) 836-3030 

(425) 836-8957 (facsimile) 
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CERTIFICATE OF FACSIMILE TRANSMISSION 
I hereby certify tfiat ttiis Amendment, along with transmittal and facsimile cover 
sheet, are being transmitted by fttcsvnile to the United States Patent and 
Trademark Office in accordance with 37 C.F.R. 1.6(d) on the data shown t>elow: 



Date: May 13. 2005 




Albert S. Michallk 



AISOAmendamt 
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